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DESCRIPTION 

IMAGE PROCESSING APPARATUS AND METHOD AND 

PROVIDING MEDIUM 

This invention relates to an apparatus and a method for processing 
images as well as a providing medium. 



As a result of the rapid spread of DTP (desk top publishing) and internet in 
recent years, color images are manipulated more often than ever on the display screens 
of CRT (cathode ray tube) displays and liquid crystal displays. 

For example, operations of drawing pictures by means of painting tools are 
being replaced by those of drawing computer graphics by means of personal 
computers. Consumers place orders by seeing images of products displayed on the 
display screen as electronic advertisements that are transmitted by way of internets. 

In any of such cases, it is necessary that the colors of the original picture (which 
may be a picture drawn by an artist or a photographic picture) and those of the 
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facsimile image of the picture output by an apparatus (which may be the monitor 
screen of a display apparatus or a color printer) agree with each other. 

Thus, it is highly desirable that, for a same picture, the image displayed on the 
display screen of a personal computer and the image output by a printer appear same 
in terms of their colors. 

In the case of an electronic advertisement, if the image of an article (e.g., a 
jacket or a painting) displayed on the display screen of the personal computer of a 
consumer appears differently from the actual commodity, a trouble may arise between 
the commodity provider and the consumer when the consumer buys the commodity. 

Thus, it is necessary to make an arrangement that a picture appears exactly 
same on all the image display appratus displaying an image of the picture particularly 
in terms of colors. 

A system referred to as CMS (color management system) is known for 
correcting the differences of colors of images of a same picture among different image 
display apparatus displaying it 

FIG. 1 of the accompanying drawings schematically illustrate a CMS. Referring 
to FIG. 1, with a CMS, the color signals of a picture input through an input device 
(e.g., camera 1, scanner 2, monitor 3) are converted into common color space signals 
(e.g., CIE/XYZ, CIE/L*a*b*) that are not dependent on the characteristics of the 
device and then output through an output device (e.g., monitor 3, printer 4). 

A conversion formula or a conversion table that is referred to as "profile" and 



I 

/ 

3 

specific to each device is used when converting a signal into that of a common color 
space. For examples, the color signals of a picture taken by camera 1 are converted 
into common color space signals by the profile specific to the camera 1 . To output the 
signals through monitor 3, the common color space signals are then converted into 
color signals that reflect the characteristics of the monitor 3 by the profile specific to 
the monitor 3 and an image of the picture formed by the obtained color signals will be 
displayed on the monitor. 

Such a profile is determined by means of the signal values input to the device 
and the color values (XYZ values or L*a*b* values) obtained by observing the colors 
of the image output according to the signal values typically through a colorimeter. 

FIG. 2 of the accompanying drawings a chart showing the flow of data when the 
image on the monitor 3 is output to printer 4. Referring to FIG. 2, the image on the 
monitor 10 is converted into signals of a common color space by the profile specific 
to the monitor 3 (monitor profile 20). In other words, the image data (RGB data) of 
the monitor 3 are converted respectively into corresponding quantities of light by 
means of TRCs (tone reproduction curve, which will be described hereinafter) 
generated by TRC generator section 20-1. The quantities of light for RGB reflect the 
colors of the image viewed by the user on the monitor 3. 

The data (on the quantities of light for RGB) generated by the TRC generator 
section 20-1 are then processed for conversion using a matrix representing the linear 
relationship between the quantities of light output to the monitor 3 and the CIE/XYZ 
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values (or L*a*b* values) to obtain a series of values (CIE/XYZ values or L*a*b* 
values), which are then output as common color space signals 30. 

The common color space signals 30 obtained by the monitor profile are then 
processed for conversion by the profile specific to the printer 4 (printer profile 40) to 
reflect the printing characteristics of the printer 4 and the obtained color signals for the 
printer, or CMY50, are printed and output. 

Apparatus of a same type can show disparity, if slighdy, in the characteristics 
depending on individual apparatus. Then, the profile is preferably calibrated for each 
apparatus. 

The profiles of the monitors marketed by a same manufacturer can be calibrated 
typically by means of a monitor calibration tool or characterization tool provided by 
the manufacturer. 

The monitor profile 20 is prepared by such a tool. FIG. 3 of the accompanying 
drawings is a flow chart of the operation of preparing a monitor profile. Referring to 
FIG. 3, firstly in Step SI, TRCs (g-curves) representing the non-linear relationship 
between the RGB data to be input to the monitor and the quantities of light of RBG of 
the monitor is prepared. Such TRCs can be obtained by observing the XYZ3-stimulus 
values of more than ten tones (e.g., 16 tones) sampled at regular intervals from the full 
range of tones (e.g., 256 tones) for each of the primary colors of red (R), green (G) and 
blue (B) of the RGB data (or RGBW. data) and applying them to the g equation out of 
equations (1) shown below by non-linear regression (a TRC is obtained by linear 
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interpolation or a conversion table if the number of samples is large). 




...(1) 

In the above equations (1), variables dr, dg and db respectively represent the 
input signal values for red, green and blue and variable N represent the number of bits 
of each input signal. Coefficient k gain represents the gain of each of thecolors (e.g., 
kr.gain represents the gain of red) and coefficient ko ffsct represents the offset of each of 
the colors (e.g., k^^ represents the offset of red). Additionally, variables Xp Y g and 
2^ respectively represent the 3-stimulus values of the three colors and variable X^^, 
Y g . max and respectively represent the 3-stimulus values of the three colors when 
the input signal values are maximal. Thus, variables r, g and b are obtained by 
normalizing Y g and 7^ respectively by the maximum values X^^, Y g max and Z^^ 
to take a value between 0 and 1 . 

FIG. 4 is a flow chart illustrating the operation of preparing a TRC 
corresponding to an input digital signal for red in Step S 1 of FIG. 3. Referring to FIG. 



4, in Step S2 1, XYZ r values (including maximum value XYZ,.^**) are observed for the 
sampled several tones from the input signal corresponding to red. Then, in Step S22, 
the input signal values dr are normalized by dividing them by 2 W -1 and, in Step S23, 
the output brightness values are normalized by dividing X, values by the maximum 
value X^nax. In Step S24, a process of non-linear interpolation is conducted by means 
of equations (1). Finally, in Step S25, the values of coefficients k, offset , k, gain and y r are 
determined. Note that operations of preparing TRCs corresponding to input digital 
signals dg and db for green and blue will be conducted similarly. 

FIGS. 5 A through 5C are exemplary TRCs for red, green and blue prepared in 
a manner as described above. 

Generally, y values for a monitor refers to those of ys in equations (1). Note 
that most of the currently available tools utilizes k gain =l .0 and k offset =0 in equations (1). 

Returning to FIG. 3, in Step S2, a matrix representing the linear relationship 
between the quantities of light of RGB and the monitor and the CIE/XYZ values are 
determined. If, for example, the monitor in question is of the self-emission type and 
the law of addition approximately holds true for the quantities of light (r, g, b) when 
mixing colors, then the CIE/XYZ3-stimulus values (Xcrt> Y crt , Z crt ) can be obtained 
from the quantities of light of RGB corrected in Step SI (normalized values) and a 3 
x m matrix as described below. For the purpose of simplification, a matrix of 3 x 3, 
which is of the most simple form, is shown below. 



7 
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...(2) 

Such a matrix can be obtained by observing the XYZ3-stimulus values of each 
of the three primary colors for the highest brightness. 

Note that, in most of the known tools of the type under consideration, the TRCs 
and the matrix are determined on an assumption that the monitor is not affected by 
ambient light and used in the dark and the monitor profile is obtained and the TRCs 
are corrected on the basis of them. 

Thus, as shown in FIG. 6, when ambient light is present, the values (CIE/XYZ 
values) obtained from the image on the monitor will be those of the colors of the 
self-emission type monitor (Xc RT , Y CRX , Z CRT ) plus those of the colors of ambient light 
reflected by the surface of the tube of the monitor (R* x (X^, Y^, Z^)) because 
ambient light is reflected by the surface of the tube of the monitor so that consequently 
they may be different from those observed when the profile was prepared (in the dark). 
Thus, there is a problem accompanying such known tools that the colors of the images 
on the monitor cannot be accurately corrected when ambient light exists. 

Additionally, as seen from FIG. 7 A, the TRC brightness will increase (shift 
from curve a to curve b) when ambient light is present In FIG. 7 A, the horizontal axis 
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represents the value of the normalized input digital signal (or the value of the input 
digital signal divided by the value of the maximum input digital signal of the monitor) 
and the vertical axis represent the output brightness of the monitor. 

FIG. 7B is a graph obtained by normalizing the vertical axis of FIG. 7 A by the 
value of the maximum brightness. As seen from FIG. 7B, the monitor shows a 
narrower dynamic range (D2<D1) when ambient light is present (and its performance 
reflects curve b* with a dynamic range of D2) than when ambient light is not found 
(and its performance reflects curve a' with a dynamic range of Dl). 

Thus, the dynamic range is narrowed when ambient light exists so that 
consequently the image on the monitor lacks sharp contrast to the viewer because of 
the partly lost dynamic range. 

Now, the monitor is provided with a function that allows the user to arbitrarily 
regulate the contrast, the brightness and the reference white (neutral) point of the 
monitor. If the function is used to change the contrast, the brightness and the 
reference white point, the TRC characteristics measured when the profile is prepared 
(the relationship between the values of the input digital signals and the quantities of 
light of RGB output to the monitor) will also have to be changed. If such is the case, 
the characteristics of the monitor will have to be measured once again to update the 
TRCs in order to accurately correct the colors. However, it is practically impossible 
to measure the characteristics of the monitor each time the above function is used and 
hence there exits a problem of a difficulty with which the colors are accurately 
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corrected on the monitor. 

Thus, it is necessary to maintain the conditions under 
which the profile is prepared (that the monitor is used in the dark 
and the contrast, the brightness and the reference white point at 
5 the time of shipment are kept unchanged) in order to accurately 
correct the colors on the monitor. If this requirement is not met 
and the conditions have been altered, the characteristics of the 
monitor have to be measured once again under the current 
conditions. 

10 Respective different aspects of the invention are set forth in 

claims 1, 2 and 3 hereof. 

A preferred form of implementation of the invention 
described hereinbelow seeks to provide an apparatus and a 
method for processing images as well as a providing medium 

15 that are adapted to accurately carry out an operation of chromatic 
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calibration with a minimal amount of data obtained by 
measurement. 

According to a salient feature of the preferred 
implementation, a total of nine tone reproduction curves will be 

5 generated in response to the outcome of detecting if the law of 
proportion holds true or not and then formulae will be generated 
to obtain color signals that are not device-dependent from the 
nine tone reproduction curves and the 3-stimulus values for the 
black level. Thus, the chromatic profile of the monitor can be 

10 accurately with a minimal amount of data obtained by 
measurement. 

The preferred implementation is particularly adapted to 
carry out color signal processing operations that may vary as a 
function of individual image display apparatus in order to 
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coordinate the colors of images to be displayed there so as to 
eliminate apparatus-dependency of the colors of images. 

The invention will now be further described, by way of 
example, with reference to the accompanying drawings, in 
5 which: 

FIG. 1 is a schematic illustration of CMS. 

FIG. 2 is a flow chart showing the flow of data when the 
image on the monitor 3 of FIG. 1 is output to the printer 4. 

FIG. 3 is a flow chart of the operation of preparing a 
10 monitor profile. 

FIG. 4 is a flow chart illustrating a conventional operation 
of preparing a TRC corresponding to an input digital signal. 

FIGS. 5 A through 5C are exemplary graphs of TRCs for 
the three primary colors of RGB. 



BNSDOCID: <GB 236951 5A_I_> 



12 

FIG. 6 is a schematic illustration showing how the 
measured color values change when ambient light exists. 

FIG. 7A and 7B are graphs illustrating how the dynamic 
range is modified when ambient light exists. 

FIG. 8 is a schematic block diagram of an embodiment of 
the invention, showing the configuration thereof. 

FIG. 9 is a schematic block diagram of the embodiment of 
FIG. 8, showing the configuration in greater detail. 

FIG. 10 is a schematic block diagram of a displayed GUI 
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the ambient light input section 101 of the embodiment of FIG. 8. 

FIGS. 1 1 A through 1 1C are graphs showing exemplary TRC characteristics that 
may be obtained when ambient light exists. 

FIG. 12 is a schematic block diagram of the embodiment of FIG. 8, showing the 
configuration in greater detail. 

FIG. 13 is a schematic block diagram of a monitor, illustrating an model of 
operation. 

FIG. 14 is a schematic block diagram of another embodiment of the invention, 
showing the configuration thereof 

FIG. 15 is a schematic block diagram of still another embodiment of the 
invention, showing the configuration thereof. 

FIG. 16 is a schematic block diagram of still another embodiment of the 
invention, showing the configuration thereof. 

FIG. 17 is a flow chart, illustrating the operation of the embodiment of FIG. 16. 

FIG. 18 is a flow chart for the processing operation of a GOG model when no 
isolated black exists. 

FIG. 19 is a flow chart for the processing operation of a GOGO model when 
isolated black exists. 

Now, the present invention will be described in greater detail by referring to the 
accompanying drawings that illustrate preferred embodiments of the invention. 
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FIG. 8 is a schematic block diagram of an embodiment of the invention, 
showing the configuration thereof. 

Referring to FIG. 8, the image processing section 100 of the embodiment 
comprises a viewing environment converting section 1 00a, a profile updating section 
100b, a monitor specific values converting section 100c and a contrast correcting 
section lOOd and is adapted to update the profile according to the information it 
acquires with regard to ambient light and the information specific to the monitor 103. 

The viewing environment converting section 1 00a calculate the XYZ^b values 
of ambient light and determines by computation the XYZ CRX values and the TRC of 
the monitor taking the influence of ambient light into consideration. The profile 
updating section 100b generates a monitor profile that reflects ambient light and the 
information set and displayed oh the display section of the embodiment and stores it 
in memory section 104. 

The monitor specific values converting section 1 00c prepares TRCs on the basis 
of the contrast and the brightness selected for the monitor 103 and generates a matrix 
from the reference white point also selected for the monitor 103. The contrast 
correcting section lOOd corrects the contrast for the TRC1 stored in the memory 104a 
of the memory section 104 and supplies the obtained TRC2 to the profile updating 
section 100b. It also generates drive values and bias values for the monitor 103. 

Note that the drive values and the bias values respectively represent the gains 
and the biases of the three colors of red (R), green (G) and blue (B) of the RGB data 
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input to the monitor 103. 

The ambient light input section 101 in FIG. 8 typically comprises one or more 
than one photosensor and is adapted to detect information on the chromaticity and the 
brightness of ambient light and supplies the obtained information to the image 
processing section 100 as information on the viewing environment. Note that the 
ambient light input section 101 maybe so arranged that the user may manually input 
necessary information by way of a GUI (graphical user interface) which will be 
described hereinafter. 

The monitor control section 102 in FIG. 8 automatically alters the TRC 
characteristics of the monitor 103 according to ambient light and the information 
selected for it. It also supply the information on the monitor 103 including the values 
selected for the reference white point, the contrast and the brightness to the image 
processing section 100. 

The monitor 103 is fed with image data (RGB data) that have been processed 
by the profile stored in the memory section 104 and then outputs and displays the 
supplied image data. 

The memory section 104 comprises memory 104a and memory 104b. The 
memory 104a stores the monitor profile whereas the memory 104b stores information 
on the reference white point, the contrast and the brightness of the monitor 103. 

The embodiment having the above described configuration operates in a manner 
as described below. 
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The embodiment of FIG. 8 is configured as to (1) generate an optimal monitor 
profile in response to the viewing environment and also (2) generate an optimal 
monitor profile in response to alteration(s) made on the selected values (on the 
contrast, the brightness and the reference white point) for the monitor 103. These 
operations will be discussed sequentially hereinafter. 

FIG. 9 is a schematic block diagram of the embodiment of FIG. 8, showing the 
configuration adapted to generate an optimal monitor profile in response to the 
viewing environment. In this configuration, the monitor specific values converting 
section 100c is not taken into consideration. Otherwise, the configuration is identical 
with that of FIG. 8. 

The ambient light input section 101 detects information on ambient light (in 
terms of the CIE/xy chromaticity and illuminance of ambient light) of the monitor 103 
by means of one or more than one photosensors mounted typically on the top of the 
monitor 103 and supplies it to the image processing section 100-1 as viewing 
environment information. 

Note that a GUI as shown in FIG, 10 may be displayed on the monitor 103 to 
input the viewing environment information in place of inputting the information on 
ambient light (viewing environment) obtained by the photosensors. In the example of 
FIG. 10, three different light sources of incandescent light, fluorescent light and 
natural light are available and an appropriate light source can be selected by checking 
the inside of a check box arranged for them. Additionally, it is so arranged that a 
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predetermined value may be directly input by the user by way of a keyboard (not 
shown) for the illuminance of the light source. The data input by the user are then 
converted into the CIE/xy chromaticity and illuminance of ambient light typically by 
means of a data table. 

The viewing environment converting section 100a of the image processing 
section 100-1 determines by computation the XYZ values of ambient light by 
substituting the viewing environment infonnation M and the reflectivity R bk of the 
surface of the tube of the monitor 103 in equation (3) below by the respective values 
input through the ambient light input section 101 : 

X.4mb 
yAmb 
1 - XAmb - yAmb 

...(3) 

where and respectively represent the x, y chromaticity points of 
ambient light and M represents the illuminance of ambient light. 

Subsequently, the viewing environment converting section 100a reads out the 
XYZ values (XYZ CRT values) of the monitor 103 corresponding to the input signals 
values dr, dg and db from the memory 104a (and hence the values obtained by using 
equations (1) and (2) above) and adds the XYZ values (XYZ^ values) of light 
reflected by the surface of the tube as determined by equation (3) above to the above 



XAmb 

YAmb 

ZAmb 



= Rbk 



M 1 



* yAmb 
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values according to equation (4) below to determine the XYZ values when ambient 
light exists: 



' X 




XCRT 




JCimb 




XCRT 




XAmb 






YcRT 
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YAmb 




Year 


+ Rbk • 


yAmb 
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* y Am b 


Z _ 


measured 




ZAmb 




ZCRT 


1 - XAmb - yAmb 



...(4) 

Note that equation (4) above is based on the assumption that the measured 
values of the colors of the monitor can be expressed as the quantity of light emitted by 
the monitor itself and the quantity of ambient light reflected by the surface of the tube 
of the monitor. 

The XYZ values obtained for a situation where ambient light exists are then fed 
to the profile updating section 100b. 

With the above processing operation, it is now possible to generate XYZ values 
for a situation where ambient light exists. However, as described above by referring 
to FIGS. 6and 7, as the illuminance of ambient light rises, the apparent dynamic range 
of the image on the monitor screen is nairowed to lose its sharp contrast. The contrast 
correcting section lOOd compensates the loss of contrast due to the raised illuminance 
of ambient light by means of a processing operation as described below. 

This processing operation for correction is carried out by modifying the 
coefficient k offsel for the offset of any of the TRCs of the monitor profile generated 
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from the XYZ3-stimulus values of the monitor 103 that is obtained in the dark in the 
negative direction (and the coefficient k gain for the gain in the direction of making it 
greater than 1). 

For example, if the curve a of FIG. 11 A is one of the TRCs for the monitor 103 
obtained when no ambient light exists (in the dark), the TRC is shifted to curve b in 
FIG. 11B when the monitor 103 is placed in an environment where ambient light 
exists. Thus, in this embodiment, a processing operation will be performed so as to 
make the TRC (curve c) obtained after the correction to be found closer to the TRC 
(curve a) obtained in the dark as shown in FIG. 1 1C 

: While the above processing operation for correction is performed independently 
for each color, or for each of the signals of RGB data, all the operations are identical. 
Therefore, only the operation for G (green) will be described hereinafter. 

Firstly, the TRC obtained for G in the dark (representing the relationship 
between the quantity of green light g and the input digital signal dg for green) is 
expressed by equation (5) below: 




...(5) 

where Y g , represent respectively the brightness and the maximum 

brightness of G observed in the dark. 



20 



Now, assume that ambient light is reflected by the surface of the tube of the 
monitor 103. Then, the brightness Y gAmb in the presence of ambient light is expressed 
by equation (6) below: 



YgAmb = Yg+ Rbk' YAmb 



v L -Ml) 



+ kg, offset \ + Rbk ' YAmb 



•••(6) 



where represents the reflectivity of the surface of the tube of the monitor 
103 and represents the brightness of ambient light. 

A TRC as shown below (TRC in the presence of ambient light) is obtained by 
normalizing equation (6). 



SAmb ~ 



Yg.4mb (Yg + Rbk • YAmb) 

YgAmbvnex (Ygvn»x+ Rbk ' YAmb) 



1 



(Ygmsx+ Rbk • YAmb) 



Ygmax- | kg, gad^ J + kg, offset^ + Rbk • YAmb 



-(7) 
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The curve to be corrected for contrast is the TRC obtained in the dark has to 
meet the requirement expressed by formula below. 

&Amb ~ 8 

...(8) 

Y g in equation (7) represents a (constant) value specific to the monitor 103 so 
that the values of k ggain and k g off5et have to be determined to meet the requirement of 
(8). If the values of kg gain and k g of&ct satisfying the requirement of (8) are k g Amb.gam 
k g .Anib.offset> equation (9) below can be drawn. 



(y*max+ Rbk • YAmb) 



J ( dg \ 

g max* i kg, Amb. gain ^ A + kg t Amp, qffse 



+ Rbk ■ YAmb 



* S 



...(9) 



Formula (9) can be modified to become formula (10) below. 
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{ d * \ 4. V 



T * 1 \ ) 

Ygmax 



...(10) 

Thus, k^.^ and k g ^ b . offset satisfying the requirement of formula (10) above 
are then supplied to the contrast correcting section lOOd and the monitor control 
section 102 as drive signal and bias signal so that the contrast and the brightness of the 
monitor 103 are regulated according to these values. Meanwhile, the new TRC 
determined by equation (7) is supplied from the contrast correcting section 1 OOd to the 
profile updating section 100b as TRCB. 

Thus, the contrast correcting section lOOd reads out the TRCA from the profile 
A (a profile prepared without taking ambient light into consideration) stored in the 
memory 104a and inputs the XYZ values output from the viewing environment 
converting section 100a to determine kg.^.g^ and k g-Amb . ofl6e t that satisfy the 
requirement of formula (10) by means of non-linear recurrence. It then outputs these 
values to the monitor control section 102 respectively as a drive signal and a bias 
signal. 

Additionally, the contrast correcting section 1 OOd outputs the new TRC obtained 
by substituting k g gain and k g offset of equation (7) with k g and kg^ff^ respectively 
(or TRC prepared by taking ambient light into consideration) as TRCB to the profile 
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updating section 100b. As a result, the profile updating section 100b stores both the 
XYZ values fed from the viewing environment converting section 100a and the profile 
B generated from the TRCB fed from the contrast correcting section lOOd (or profile 
prepared by taking ambient light into consideration) into the memory 104a. 

Thus, it is possible to compensate the loss of contrast by the above processing 
operation for correcting the contrast. 

However, as a result of the above contrast compensating operation, there can 
be occasions where the image displayed on the monitor 103 can appear dark. If such 
is the case, it is desirable that the determined values of k g>Amb , gain and k giAjnb offsct are 
multiplied by an appropriate constant of proportion. 

If the monitor 103 is a broadcast monitor, values such as Y=2.2, k gain =1.0 and 
kofiset = 0 will b e used in the dark. If such a monitor is used in an office, the above 
problem of the displayed image that appears dark can be alleviated by selecting a value 
between 1.0 and 1.4 for k gain and a value between -0.4 and 0.0 for k offset .. 

As described above, the operation of correcting the measured color values of the 
viewing environment converting section 100a is an operation of updating the 
relationship between the CIE/XYZ values that are not device-dependent and the RGB 
data of the monitor 103 and hence in line with the concept of CMS as discussed earlier. 

The contrast correcting section lOOd corrects the contrast of the image 
displayed on the monitor in order to reproduce the desired colors in the presence of 
ambient light. 
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Thus, with the above processing operation, it is possible to generate an optimal 
profile B for a viewing environment where ambient light exists firom the profile A 
prepared for a completely dark viewing environment without determining the 
characteristics of the monitor 103 for another time. 

Now, the configuration (2) of the embodiment adapted to generate an optimal 
profile when the user modifies the setting of the monitor 103 (in tenns of contrast, 
brightness and reference white point) will be described by referring to FIG. 12. 

In FIG. 12, the viewing environment converting section 100a and the contrast 
correcting section lOOd are omitted from the configuration of FIG. 8. Otherwise, the 
configuration is identical with that of FIG. 8. Before describing the operation of this 
configuration, a model of operation of monitor 103 will be discussed by referring to 
FIG. 13. 

FIG. 13 is a schematic block diagram of a monitor, illustrating an model of 
operation. Referring to FIG. 1 3, computer system 200 comprises a host computer 200a 
and a DA (Digital to Analog) converter 200b and is adapted to output video signals 
corresponding to a requested image. 

On the other hand, CRT display system 300 comprises a video amplifier 300a, 
a CRT electron gun 300b and a fluorescent body 300c as well as other components. 

The model operates in a manner as described below. For the simplicity of 
explanation, only signals for R (red) will be described. 

Of the RGB data output from the host computer 200a, the input digital signal 
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dr for red color is linearly converted into a video signal voltage V r by the DA converter 
200b, using equation (1 1) below: 



where Cont and Bit respectively correspond to the information on the contrast 
and the one on the brightness selected for the monitor 103 and determine the video 
voltage of the white level and that of the black level of the monitor 103. 

The video signal voltage V r obtained by the DA converter 200b is amplified by 
the video amplifier 300a of the CRT display system 300, using equation (12) below 
and then supplied to the electron gun 300b: 

Vcr = driver -Vr+ biasr 



where drive r represents the gain of the video amplifier 300a and bias r represents 
the offset of the video amplifier 300a. 

The rate at which an electron beam is shot from the CRT electron gun 300b is 
a function of the voltage different of the control grid voltage (V^) and the cutoff 
voltage (V Cr ) at which an electron beam starts to be emitted from the gun and the 




...(id 



...(12) 
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electric current (j r ) gushes out from the electron gun 300b is expressed by known 
equation (13) below: 

J r = p (yG.r-Vc,r) r ' (VG.r-Vc.rZO) 

...(13) 

where p represents the coefficient of the current efficiency of the electric 
current discharged from the electron gun 3O0b and is referred to as perveance. 

The electrons discharged from the electron gun 300b collide with the fluorescent 
body 300c applied to the inner surface of the CRT panel to make it emit light. The 
radiant quantity of light L r from the fluorescent body 300c is expressed by equation 
(14) below: 

Lr=kr'Jr 

...(14) 

where k, is a constant indicating the extent of influence on the light emitting 
efficiency of the fluorescent body and the radiant quantity of the CRT glass panel. 
Now, equation (15) can be derived from equations (11) through (14). 
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If bias r - V c r in equation (15) is replaced by bias r , or if bias r - V CI . = bias r , then 
equation (16) below is obtained. 











Lr = kr-f 


driver 


Cont '{ 2 " _l) + 2?rt 


+ biasr * 



Yr 



-.(16) 

From equation ( 1 6), the radiant quantity L rjnax when the input digital signal (dr) 
for red shows the maximum value (dr=2 N -l) is obtained by equation (17) below. 

Lr, max = h • p[driver(Cont + Bri) + biasrY r 

...(17) 



Then, equation (18) is obtained by normalizing L r by L,. 
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driver 
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+ biasr 



drive r {Cont + Brt) + biasr 



-(18) 

The equation (18) can be modified to produce equation (19) below. 
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Lr 



Lr,, 



driver • Cont 



drive r (Cont + Brt) + bias^ 
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driver • Brt + biasr 
drive r {Cont + Brt) + biasJ 



7r 



...(19) 

Assume here that gain coefficient K,. gain and offset coefficient of the 

normalization model are expressed by equations (20) below. 



kr. 



driver • Cont 



gain — 



drive r {Cont + Brt) + biasr 



kr. offset — 



driver ■ Brt + biasr 



drive r {Cont + Brt) + biasr 



...(20) 

Then, equation (21) is obtained by substituting equation (19) by equation 



(20). 
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•(21) 



BNSDOCID: <GB 236951 5A l_> 



29 

The equation (2 1) represents the relationship between the radiant quantity of the 
fluorescent body for red and the input digital signal value dr. and is identical with 
equations (1) above to prove that the above model fits well to the actual monitor 103. 

Thus, the TRC showing the relationship between the quantity of light of the 
monitor and the input digital signal value can also be expressed by equation (21) or ( 1). 
Since y is a (constant) value specific to the monitor in either of these equations, if any 
of the values for the setting of the monitor 1 03 is changed, a new TRC can be obtained 
by modifying only and K,.^. 

Now, from equation (20), it will be appreciated that Cont and Bit contained in 
the two equations correspond respectively to the contrast and the brightness of the 
monitor. As a matter of fact, K,. gain and offset change their values as the values of Cont . 
and Brt change. 

Note that Cont and Brt are common to all R, G and B signals and hence the 
quantity of light coiTesponding to any of such signals change when these values are 
modified. 

Now, an occasion where the user wants to modify the reference white point of 
the monitor 103 will be discussed below. 

The reference white point of the monitor 103 is determined by the ratio of the 
quantities of light of RGB. Thus, the reference white point can be modified by 
modifying the gain (drive r in the case of red) and the offset (bias r in the case of red) of 
the video amplifier for each of the colors as expressed in equation (20) above. 



Thus, if the user wants to modify the reference white point of the monitor 103, 
an optimal TRC can be generated in response to the modification by correcting the 
value of the gain and that of the offset (k eain , k offset ) for each of the colors of the monitor 
profile. 

Since the chromaticity value of white changes as the reference white point 
changes, the matrix of equation (2) showing the relationship between the quantities of 
light and the CIE/XYZ values of the monitor 1 03 will also change. Then, the modified 
matrix can be obtained in a manner as described below. 

Firstly, r=l, g=0 and b=0 are used in equation (2) showing the relationship 
between the brightness values (CIE/XYZ values) and the quantities of light (r, g, b) to 
determine the CIE/XYZ values (X,.^, Y rjnax , Z, max ) for the maximal brightness of red. 

Subsequently, the CIE/xyz chromaticity values (Xp y^ Z,) of red is obtained by 
means of equations (22) below showing the relationship between CIE/XYZ values and 
CIE/xyz values. 



Xr = 




r, max 



y r = 




Zr = 1 - Xr - yr 



.-(22) 
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Then, a similar operation will be conducted for both green and blue to determine 
the values of (x g , y g , Zg) and (x b , y b , z b ). 

Note that the relationship between the color temperature and the chromaticity 
point of white of the monitor 103 may be expressed in the form of a data table so that 
chromaticity point data (x w , y w , z, v ) corresponding to the modified color temperature 
may be read out from the table. 

Then, the mixing ratio (h' r , h f g , h f b ) that provides a reference white point for the 
maximal quantities of light of R, G and B is determined from the data obtained in a 
manner as described above. Since the monitor 103 is a self-emission type device and 
the law of addition substantially holds true for mixed colors, equations (23) below can 
be drawn. 

h' rXr + h'gXg + k'bXb = Xw 

h' r y r + h'&g + h'tyb = yw 

K rZr + ft gZg + h % bZb = Zw 

-.(23) 

Since the chromaticity data (x w , y w , z^) are proportional to the stimuli of the 
colors, equations (24) below can be obtained through normalization by. y w , using 
h^h'/y^ h g =h' g /y w and h b =hVy w - 
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Thus, the mixing ratio (h,, h g , h b ) of the colors can be obtained by solving the 
equation (24) above. Then, CIE/XYZ values can be obtained from the values of r, g, 
b that are obtained through normalization using the maximum brightness values of R, 
G, B and equation (25) generated by using the mixing ratio. 
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...(25) 

where 0 <r, g, b <1 and 0 < Y CRT <1. 

As a result of the above operations, the matrix can be updated whenever the 
reference white point is modified. 

Now, the operation of the embodiment of FIG. 12 will be described on the basis 

of the above explanation. 

If the setting of the monitor 103 (in terms of contrast or brightness) is modified, 
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the monitor control section 102 retrieves the values of Cont and Brt from the monitor 
103 and supplies them to the monitor specific values converting section 100c of the 
image processing section 100-2. 

Then, the monitor specific values converting section 100c generates a new 
TRCB by correcting the values of the gain and the offset (k gain , k offsct ) in equations (1), 
referring to the values of Cont and Brt fed from the monitor control section 102 and 
supplies the new TRCB to the profile updating section 100b. 

If, on the other hand, the reference white point of the monitor 103 is modified, 
the monitor specific values converting section 100c retrieves the data on the 
chromaticity point corresponding to the modified color temperature from the data table 
stored in advance. 

Then, it generates a new matrix by solving the equation (24) and determining 
the mixing ratio Ov h g , h b ) and outputs it to the profile updating section 1 00b as matrix 
B. 

The profile updating section 100b prepares a new profile, or profile B, on the 
basis of the TRCB output from the monitor specific values converting section 100c and 
the matrix B and stores it in a predetermined region of the memory 104a. 

With the above operations, if the data on the setting of the monitor (contrast, 
brightness, reference white point) are modified by the user, it is now possible to 
generate a profile corresponding to the new setting of the monitor 103 by updating the 
(initial) profile prepared in the dark without measuring the values of the characteristics 
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of the monitor 103 once again. 

FIG. 14 is a schematic block diagram of another embodiment of the invention, 
showing the configuration thereof. Note that, in FIG. 14, the components same as or 
similar to those of FIG. 8 are denoted respectively by the same reference symbols and 
will not be described any further. 

This embodiment is so designed that the appearance of colors is held unchanged 
if the image being displayed by it under a set of predetermined operating conditions, 
or conditions 1 , is moved to a place with a different set of operating conditions, or 
conditions 2. 

In FIG. 14, monitor 103-1 refers to the monitor when it is used in operating 
conditions C (conditions 1), which are represented by setting information C and 
ambient light information (viewing environment information) C. 

Then, in FIG. 14, monitor 103-2 refers to the monitor when it is used in 
operating conditions D (conditions 2), which are represented by setting information D 
and ambient light information (viewing environment information) D. Thus, the 
monitor 103-a and the monitor 103-2 are a same and identical monitor. 

The image processing section 100 comprises image processing section 101-1 
and image processing section 101-2 respectively shown in FIGS. 9 and 12. 

This embodiment operates in a manner as described below. 

Under the operation conditions C, the RGB data C output to the monitor 103-1 
are corrected by the profile C modified in response to the user-selected setting 
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information C and the ambient light information C. 

To display the RGB data C on the monitor 103-2 under the operating conditions 
D, firstly the original data (the data before corrected by the profile C in response to the 
user-selected setting information C and the ambient light information C) are restored 
by means of the TRCC and the matrix . C contained in the profile for the operating 
conditions C. 

The restored data are then corrected by the profile D for the operating 
conditions D before output to the monitor 103-2. 

With the above processing operation, it is now possible to make the two 
monitors 103-1 and 103-2 to display a same image in terms of colors, contrast and 
brightness if the monitors are actually a same monitor 103 and only the operating 
conditions (including the user-selected setting values and the viewing environment) are 
changed. 

FIG. 15 is a schematic block diagram of still another embodiment of the 
invention, showing the configuration thereof. 

Note that, in FIG. 15, the components that are same as or similar to those of 
FIG. 8 are denoted respectively by the same reference symbols and will not be 
described any further. 

This embodiment is so designed that the image displayed on monitor 103-1 is 
transferred to monitor 103-2 by way of internet 500 and displayed on the latter 
monitor. 
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The image processing section 600 comprises an image processing section 100 
that receives the image transmitted by way of internet 500 and outputs the received 
image to the monitor 103-2 after carrying out predetermined processing operations on 
it. 

This embodiment operates in a manner as described below. 
The RGB data C displayed on the monitor 103-1 of the transmitter are 
transmitted to the receiver by way of internet 500 after the profile C stored in memory 
I04a-1, the information on the initial operating conditions (the operating conditions 
when the profile is generated) and the information C on the current operating 
conditions are added thereto by the monitor control section 102-1. 

Since the monitor 103-1 of the transmitter is not provided with the functional 
feature of correcting the image data according to the operating conditions, the 
appearance of the colors of the image displayed on the monitor 103-1 is affected by the 
viewing environment and the setting of the monitor 103-1. 

Then, the image processing section 600 of the receiver receives the information 
transmitted from the transmitter. 

The image processing section 600 then extracts the profile C and the RGB data 
C from the transmitted information and performs an converting operation on the RGB 
data C by means of the obtained profile C to generate XYZC data. 

The image processing section 100 carries out an operation of correcting the 
obtained XYZC data that reflects the operating conditions of the transmitter. More 
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specifically, the image processing section 100 corrects the XYZC data by referring to 
the information on the initial operating conditions and the one on the operating 
conditions C. As a result, the XYZC data are converted to XYZD data that reflects the 
actual appearance of colors of the transmitter. 

The obtained XYZD data are then converted to RGB data E by the profile E 
generated by the image processing section 100 to reflect the operating conditions E of 
the receiver and stored in the memory 104a-2 and then output to the monitor 103-2. 

The above described embodiment is adapted to transmit the image displayed on 
the monitor 103-1 by way of the internet 500 and display it on the monitor 103-2. 
Thus, if the transmitter is not provided with a functional feature of correcting the 
profile according to the operating conditions, the image displayed on the transmitter 
and the one displayed on the receiver can be made to appear same and identical by 
transmitting the RGB data to which information on the operating conditions is added 
and correcting the transmitted data to reflect difference between the operating 
conditions of the transmitter and those of the receiver. 

Now, if the monitor emits light if the input signals (dr, dg, db) shows values of 
(0, 0, 0) (which represents no substantive image data), the law of addition of colors 
(the sum of the 3-stimulus values of the individual colors of RGB * 3-stimulus values 
when the three colors of RGB are emitted simultaneously) does not hold true. 
However, according to the invention, the colors can be calibrated accurately by 
minimally measuring the chromatic characteristics of the monitor. This function will 
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be described in terms of two different occasions, when the law of proportion holds true 
for spectral distribution of light and when the law does not holds true. 

When the law of proportion holds true for spectral distribution, the profile of 
spectral distribution (L^, L w L^) (P=A.) of the colors of RGB of the monitor is 
constant regardless of their intensities and equation (26) below applies. 

Lr, X—Y- Lr, X, max 
Lg,X — g' Lg. A, max 
Lb.X - b- Lb, A, max 

...(26) 

Then, if only the emission of red light is measurable or if the emission of light 
other than red light can be isolated from the measured value typically by means of a 
technique of principal component analysis, the XYZ3-stimulus values (X,, Y n Z,) are 
expressed by equations (27) below on the basis of the physical properties of the 
monitor. 
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Xr = Xr, max 



dr > 

kr, gain ' _ j + 0 #«^ 



7r = Yr t max^ &r, gain • j + j 



TV 



Zr = Zr, max^ £r, gain ' ^ + kr .offset j 



...(27) 



By normalizing the equations (27) by the maximum values of the 3-stimulus 
values (X^, Y rjnax , Z^, equations (28) are obtained. 



* (, dr « V' 

r*(j^)= — = I kr.gam'—jj " + Kr, offset] 

Ar, max \ Z ~ 1 / 

r'(Z) = v = i^.som--rji — 7+ I 

Zr, max \ Z — 1 / 
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...(28) 

As shown by equations (28), the formulas for the channel to be used for XYZ 
can alternatively be expressed by using a single formula. Note that equations (1) are 
realized by using the equation of r'(X) above. In the above equations, N represents the 
number of bits of the input signal and y r represents the number to be used for the tone 
characteristics of red. While the equations of (28) are produced for red, similar 
expressions can be produced for green and blue. ThuS, the formulas for the channel 
to be used for expressing the tone characteristics representing the relationship between 
the input digital signal (dr, dg, db) and the quantity of light for any of RGB can 
alternatively be expressed by means of a single formula. In other words, only a total 
of three formulas may be used for the three colors of RGB. Then, all the colors 
displayed on the monitor can be expressed in terms of CIE 122- 1996, using XYZ values 
((X, Y, Z) measured ) and equation (29) below. 



' X 




Xr, max 


Xg, max 


Xb y max 


V 


Y 




Yr, max 


Yg, max 


Yb, max 


g' 


Z 


measured 


Zr t max 


Zg, max 


Zb, max 


V 



-(29) 

In the actual monitor, if the input signal is used only for a single color, it is 
difficult to accurately measure the emission of light of that color. In most cases, a 
slight emission of light of different colors will be picked up and measured due to the 
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mutual effect of the channels and the regulated state of the black level. However, if 
the values of the RGB digital input signals of the monitor are (0, 0, 0), it is proved by 
experiments that the above theory holds true provided that the rate of light emission 
of the monitor is sufficiently low (and the black level is not isolated). 

Nevertheless, once the user arbitrarily regulates the contrast and the brightness 
of the monitor to shift the black level, the monitor can emit light even (and the black 
level can become isolated) if the values of the RGB digital input signals of the monitor 
are (0, 0, 0). If such is the case, the offset coefficient k offset will take a positive value 
and the quantities of light of RGB (r*, g\ b') when the input signal values are (0, 0, 0) 
can be expressed by equations (30). 

r'= {kr.off^Y', g'= (W~/) rf , £*= 

...(30) 

Thus, the XYZ3-stimulus values (X^, Y min , Z min ) of the colors of RGB can be 
expressed by equations (31) for the black level. 
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Xr. min = Xr, max' kr t offset 
Yr. min = Yr.mvr kr, offset" 
Zr, min = Zr, max' kr, offset" 

Xg, min = ^g. max- &g, q0s«f 
Yg, min = 7g, max- kg, offset 
Zg. min = Zg t max- &g, o#*' 



Xb , min — % max' , offset 
7*,min = Fornax- kb, offset" 
Zb. min = Zb, max* fa. offset' b 

...(31) 

The XYZ3-stimulus values (X kjnin , Y kW of the black level can be 

expressed by equations (32) below. 



Xk, min = Xr f min+ Xg, min+ Xb, min 
5^, min = Yr. min+ 7g. min+ Yb, min 
Zk, min = Zr, min+ Zg, min+ Zb, min 

...(32) 

Taking light of the three colors into consideration, if an input signal is applied 
only to the red channel, the measured 3-stimulus values (X^^a, Y r . measured , Z,.^^) 
will be expressed by equations (33). Equations (34) can be obtained by normalizing 
the equations (33). 
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Xr, measured = Xr t max^ kr, gain ■ ~ + kr, offset J + Xg, min+ Xb, i 



7r 



Y r, measured = Yr, max^ Ar, gow • + kr, offset J + Fg, min+ min 

Zr, measured — Zr, m ax kr 

» gain • — — - + q#se/J + Zg, min+ Z&, min 



-.(33) 



r measured f J dr . J -A^, max 

'"(^0 = ~ v = {kr.gain'-J} " + *r. e#«r +~ A* 

Ar f max \ 2 — 1 / -Ar,max 



.As.max _ , max 
+ — kg. offset * + — Kr t offset h 



Xr, 



max 



r"(y> 



measured 
Yr, max 



rfr ^ * 7g, max Yo.max ^ 

kr,gain-—J} ~ + kr, offset) + ~ kg, offset + Kr, offset 

2—1 / ir, max / r. max 



Zr, measured f , dr , V' Zg. max „ o Zb,max 

r" (Z) = — = I kr, gain • ~^ 7 + offscl + 7 o^t 78 + ~ kb. 

Zr, max \ 2—1 / Zr, max Zr.max 



offset 



ib 



...(34) 

In equations (34), the value of the offset terms (the rightest two terms of each 
of the equations (34)) differs for each of the channels of XYZ. 
Now, equations (35) holds true. 



BNSDOCID; <GB 236951 5A_I_> 



44 



^r^nax > ^g,max> -^b,max 
Yg,max > ^r^nax> ^b,max 
Zb,max > ^max' ^g,max 

...(35) 

Also, equations (36) holds true v/hen the black level (0, 0, 0) is close to that of 
achromatic color. 

(kr, offset * (kg. offset * (kb.^T 

.-(36) 

Therefore, it will be seen that, in equations (34), the offset term of r"(X) (where 
the denominator has a large value) is smaller than the offset terms of r"(Y) and 
r"(Z) (where the numerators Y gJMX , have a large value). This means that the TRC 
characteristics (tone characteristics) are different for each of the channels of XYZ so 
that three channels may be conceived for each of the RGB channels to produce a total 
of 9 TRCs. If such is the case, the XYZ3-stimulus values cannot be transformed by 
means of equation (37) of CIE122-1996 (same as equation (29) above) because no 
single TRC can be selected for each of r", g" and b". 



1 
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' X 




JCr, max X% w max Xb> max 


V 


Y 




Yr, max Yg, max Yb, max 




Z 


measured 


Zr, max Zg, max Zb t max 





Therefore, equations (33) will be developed to produce equations (38) 
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( dr V' 

X. measured = X, max(^r, • + *r. tfta J + Xg.mn^ Xh. min 

= Xr. max( *r. • ^"j" + «^/] + (Xr. min+ Ai. min+ Xt. min) - Xr, 

= ^Xr.^kr, g air,'^ L ^+ kr.offs^ ~ Xr, min ' + A*, min 

7r, M-mri = Yr. max[ *r, gam • ^"j" + **J " + 7 * min+ 7 *' 

= Yr. max( kr. gain • ^"j" + *>. + (Yr. min+ 7g. min+ 7*. min) - Yr. mi 

= | Yr. max^ £r. gam • ~ + - Yr. m 

Zr. measured = Zr. m«( fcr. gain • + ^ ^ + ^ ^ 

= Zr. mj^ kr. gain • ^ ~ + fcr. + (Zr, min+ Zg. min+ Za, min) - Zr 
= |zr, mnx^ £r. gain • " + kr. off*^ ~ Zr. min - + Zk. min 



-(38) 

Equations (38) can be transformed respectively into equations (39). 
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( dr V' 

mt ~ur<4 - Xk, min = Xr, grin ■ + fc « *"J ~ X> ' 

- rt. min = Yr, njjCr, gain • JTJJ + fc. " «* 



Yr, measured 



...(39) 

Then, equations (39) can be transformed respectively further into equations 

(40). 



— = kr. gain • —77 7 + Kr.effset v 

= \ Kr, gain ' ~TJ} 7 + Kr, offset 



Yr.w* \ 2-1 ' rr '' 

?r,m««W Zk.mm ( dr Y' Zr. 

= kr.gain'-TJ} 7+ Kr.offset) 

Zr, max V 2" - 1 / • 



min 



max 



••(40) 
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Thus, equation (41) holds true. 

Xr,xmn Yr.min Zr t mm u 

, — = = Kr, offset 

X-.max Tr.max Zr, max 

-.(41) 

If the value of equation (41) is cr, equations (40) can be transcribed to equations 

(42). 



!/, measured — Xk y min f . | 
Z-.max V 2 ~1 / 



...(42) 

When the two sides of the equations (43) are multiplied by formulas (43) 
spectively so as to normalized them and make them take a value that is equal to 1 at 
maximum, equations (44) below will be obtained. 



re 
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, max 



Xr, max Yr t m*x Zr,i 

Xr.max- X,min ' Yr, max- Yr t min ' Zr, max- Zr, min 



••(43) 



r"'(X) = 



yCr* measured , nun 

Xr t max - At, min 



;A/-,m»x- -Ar.min ^\ X - 1 ' J 



r"'(Y) = 



Xr 

I r, measured ~ 

Yr f max— J^r, min 



Ir,m»— Jr. min ^\ Z 1 ' 



r"'(Z) = 



Z*r % measured — Z* 
Zr, max— Zr, min 



Zr T max— Zr.min I \ Z — 1 ' 



...(44) 

Thus, it will be seen that equation (45) below holds true. 



Xr, mac Yr.mtx Zr, bb 

Xr.max- -Xr, min Tr, max- Yr, min Zr, max- Zr.i 



•(45) 
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Therefore, equations (44) can be transcribed to produce equations (46) 

below. 



Xr t max*" 


- Xr % min 


Yr t measured 


— Yk y min 


Yr, max- 


Yr, min 


Zr, measured 


- Zk, min 


Zr, max- 


Zr x min 



-(46) 

As will be seen from the above equations, the TRCs of the channels of XYZ for 
red are expressed by an identical equation so that the TRC (tone) characteristics of the 
red channels can be expressed unequivocally by means of a GOGO model (which will 
be described hereinafter). 

Thus, the TRCs for the channels of RGB are expressed by equations (47) below. 
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Xr, measured ~~ , mm 
j.tn = — 

Xr, max— X%, min 

Yg t measured "~ min 
^/n = _f 

° Yg, max- IV min 

Zb. measured — Zk, min 

= — 

Zb, max— Z&, min 



■)"-} 



...(47) 

Then, the conversion to XYZ3-stirnulus values can be realized by means of 
matrix (48) below, using r m , g"' and b" for expressing the quantities of light of RGB 
after correcting the non-linear characteristics by means of the TRCs: 



X 




Xr, max— 


Xr, min 


max— 


J¥*, min 


uY*6, max— Xb, min 


j.i 1 1 




Y 




Yr, max— 


Yr, min 


max— 


min 


jT&, max— 2^, rain 


g'" 


+ 


Z. 


measured 


Zr, max— 


Zr, min 


Zg, max— 


Zg, min 


Zi, max— Zb, min _ 








Xr, max— 


Xr, min 


^f.max- 


J^,min 


^Yi, max— -#6, min 




min 




Yr, max- 


I^min 


max- 


Yr, min 


Fi,max— min 




run 




Zr, max— 


Zr, min 


Zg, max- 


Zg, min 


Zi, max- Zb,mm 


Z*. 


min 



Jl*, min 
yir.min 
Zfc,min 

6'" 
1 



...(48) 



where 



Xr,nax,m*arurtd = .Xr,max+ .A$,min+ Xi.min 
JCt, min = Ar, min+ , nrin+ -Xi, min 
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.-(49) 

therefore, equation (50) can be obtained. 

Xr. max- Xr, min = Xr, max, measured - Xk, min 

.-(50) 

The above description can be applied also to green and blue. Thus, it is possible 
to ultimately realize the conversion to XYZ3 -stimulus values by means of 3 x 4 matrix 
of (51) below. 



X 
Y 
Z 



Xr. max, measured - Xk, mil. Xg, max, measured - Xk,mm Xb. max, measured - Xk , min Xk, mi« 
Yr, max, measured - Yk, min Yg, max, measured - Yk, min Yb, max, measured - Yk, min Yk, min 
Zr, max, m«tru-.4 - Zk. min Zg, max, measured - Zk, min Zi, max, measured - Zk, min Zk, min 



1 



-.(51) 

When the color reproduction characteristics of the monitor cannot be expressed 
accurately by means of the technique of CIE122-1996 or when the black level is 
isolated due to the setting of the monitor in terms of contrast and brightness, the TRC 
characteristics can be expressed by means of a GOGO model, using the tone data 
obtained by subtracting the measured values at the black level from the measured 
values for RGB in a manner as described above and also by means of the 3 * 4 
conversion matrix obtained from four measurements of XYZ3-stimulus values for each 
of RGB when the input signals for RGB are maximal and of XYZ3-sumulus values at 
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the black level (input signal=(0, 0, 0)) so that it is now possible to accurately calibrate 
the colors by measuring minimally the color characteristics of the monitor. 

As described above, when the law of proportion holds true for spectral 
distribution of light, the tone characteristics of RGB can be expressed in terms of a 
total of three TRCs, one for each of RGB channels, using the data obtained by 
subtracting the data for the black level from the tone data for each of RGB in a manner 
as described above if the black level is isolated. However, in the case of a 
self-emission type display (that may be a CRT of a low cost model) where the law of 
proportion does not hold true for spectral distribution for any of RGB, or where 
equations (26) do not hold true, the above color calibration technique can give rise to 
large errors. 

If such is the case, since equations (41) and (45) do not hold true in the process 
of deriving equations (46) from equations (33), the TRC for each of RGB cannot be 
determined unequivocally. Therefore, like equations (34) for red, the TRCs for green 
and blue obtained from the 3-stimulus values will be expressed by equations (52) 
below. 
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Xr, measured 

r n (X) = — " 

Sir, measured , max 

Xr.m^kr.gain.dr/^ - 1) + k,4*Y' + Xg^JCg. tf,,/' + Jft, m«, fa, ^«/» 

Xr, measured, max 



Xg, measured 

g"(X)=— 

JLg j measured » max 

Xt.^h.lrtndrKl" ~ 1) + + Xr, + ^.m^fa.c^ 

measured, max 



. measured 

b"(X) = -r; " 

Jib, measured, max 

, measured, max 



.-(52) 

The TRCs for Y and Z can be determined in a similar manner to produce a total 
of 9 TRCs, or 3 TRCs for each of the three primary colors. Assume now that the 
measured XYZ3-stimulus values are expressed by equations (53) below for any of the 
three colors. 
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dr dr u 

Xm**s*r<d = Xr, m»(Ar, gain " + A>. c^.t) 7 ' + Ai, m«(fe, ga,n . ^ _ " + Kg,<&»t) 

db „ 

+ 7*, inax(fo, *«« • ~ £ " + Ai. <&<t) 

dr dr 

+ Zfc, ro«(fo, - _ ^ + 



...(53) 

From equations (52), the equations of (53) can be modified to equations (54) 

below. 
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Xmeasured = Xr, measured, max 7*" ( JQ - ( Xg, max, fe. W + Xb, max, fo. «T«r rt ) 
+ m«W. max g" (X) - (X, max, kr, t&et 7 ' + Xfc, max, kb, ) 
+ Jti, maaaarei/.max b" (X} — (.Xi-.max, kr, offset + X*. max, *) 

7-aoW = Yr, messsured, max r" (7) - (7*. max, ^, offset 7 ' + 7*. max. fc, ) 
+ Yg, m«W, max g" (7) - (Jr. max, Ar, offset 7 ' + 7*. max, fe. off* 7 * ) 
+ 7i, max b" (7) - (Yr, max, kr, offset 7 ' + 7,, max, kg, offset ) 



Zm««W = Zr. measured, max I"" (Z) - (Zj, max, fcg, + Zi, max, fe, offset 7 > ) 

+ Zg, measured, max g" (Z) - (Zr, max, *r, + Zb, max, fo, <a£« r * ) 

+ Zb, measured, max b" (Z) - (Zr, max. /£r, offset'' 4 Z«. max, . offset 7 ' ) 



...(54) 

Additionally, equations of (54) can be modified to equations (55), using 
equations (31) and (32). 



« 
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Xmeasured = Xr, measured, max 7*" ( + .Ag, measured, max g" ( A') + Xb, measured, max 



ymea^u^ = Yr, measured, max /*" (F) + Yg, measured, max g" (F) + 1^, measured, max 



6" (7) -27*. mi, 



Zmeasured = 2r. measured, max 7*" (Z) + Zg, measured, max g" (2T) + .Zi, measured, max 



Z>"(Z)~ 2Z*,min 



...(55) 



Thus, for the purpose of color calibration of a self-emission type display where 
the law of proportion does no hold true for spectral distribution for any of RGB, the 
XYZ3-stimulus values can be determined not by means of matrix conversion using 
CIE122-1996 or equations (51) but from the nine TRCs and the 3-stimulus values for 
the black level. 

FIG. 16 is a schematic block diagram of an embodiment of the invention 
comprising an image processing section 100 adapted to perform the above processing 
operations. In this embodiment, the image processing section 100 comprises an 
evaluating section 701 and a data processing section 702. The proportion law 
evaluating section 7 1 1 of the evaluating section 70 1 determines if the law of proportion 
holds true or not for spectral distribution of emitted light of RGB and outputs the 
outcome of the evaluation to the black isolation evaluating section 712 and the TRC 
preparing section 722 of the data processing section 702. The black isolation 
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evaluating section 712 determines if the black level is isolated or not and outputs the 
outcome of the determining operation to the addition law evaluating section 713 and 
the TRC model selecting section 715. 

The addition law evaluating section 713 determines if the law of addition holds 
true for mixing the colors of emitted light and outputs the outcome of the determining 
operation to the matrix selecting section 714. The matrix selecting section 7 14 selects 
the type of matrix for the purpose of conversion to XYZ values. The TRC model 
selecting section 715 selects a TRC model. 

The matrix preparing section 721 of the data processing section 702 prepares 
a matrix for the purpose of conversion to XYZ values in response to selection of the 
matrix selecting section 714 and outputs the prepared matrix to the profile preparing 
section 723. The TRC preparing section 722 prepares TRCs for each of the channels 
for RGB in response to the selection of the TRC selecting section 715 and outputs the 
prepared TRCs to the profile preparing section 723. The profile preparing section 723 
prepares an ICC profile and outputs it to the memory section 104. 

Now, the operation of the image processing section 100 will be discussed by 
referring to the flow chart of FIG. 17. Note that the processing operation of FIG. 17 
is conducted for a self-emission type display. Firstly, in Step S41, the proportion law 
evaluating section 71 1 of the evaluating section 70 1 receives digital signals (dr, dg, db) 
as inputs. At this time, it also receives an identification code that indicates if the 
display is a CRT or not. In Step S42, the proportion law evaluating section 711 
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determines if the law of proportion holds true for spectral distribution of emitted light 
of RGB. In other words, it determines if the equations (26) above hold true or not. If 
ihe proportion law evaluating section 7 1 1 determines that the law of proportion holds 
true, it outputs the conclusion to the black isolation evaluating section 712. 

Upon receiving the conclusion of the proportion law evaluating section 7 1 1 that 
the law of proportion holds true, the black isolation evaluating section 712 determines 
in Step S43 if a black isolation is there of not. In other words, it determines if the 
monitor emits light despite that the input digital signals (dr, dg, db) are (0, 0, 0) and 
there is (no image data) or the monitor does not emit light. If the black isolation 
evaluating section 712 determines that there is no black isolation, the operation 
proceeds to Step S44, where the TRC model selecting section 715 deterrnines if the 
monitor is a CRT or not. If it determines that the monitor is a CRT, the operation 
proceeds to Step S45, where the TRC model selecting section 715 selects the simple 
model or the GOG model out of the models listed in Table 1 below that contains the 
simple model, the GOG (gain-offset-gamma) model and the GOGO 
(gain-offset-gamma-offset) model and outputs the outcome of its selection to the TRC 
preparing section 722, 
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Table 1 



No. 


Name 


Model Formula 


Comment 


1 


Simple 


Y = X Y 


Simplest and widely use 


2 


GOG 


Y = (aX + b) Y 


Introduced in CIE tech.rep. 122-1996 


_3 


GOGO 


Y = (aX + b) Y +c 


Proposed in IEC/CD61966 part3 



Now, each of the above models will be described briefly. As seen from Table 
1. the simple model is used to generates a TRC according to the characteristics of 
Y=X" (P=Y) and has an advantage that the tone characteristics of the monitor is 
expressed only by a single index of power exponent, although it is frequently no. 

satisfactorily accurate. 

The GOG model is used in the CIE Technical Report CIE122-1996 and 
generates a TRC on the basis of equation Y=(aX+b)> (P-yJ. where coefBcient a 
represents the gain and coefficient b represents the offset. Since the GOG model is 
obtained from the physical properties of the CRT monitor, it can represent the tone 
characteristics of the monitor very well. However, it may no longer be able to 
represent the tone characteristics of me monitor when the user arbitrarily changes the 
setting of the monitor such as contrast and brightness and the black level of the 
monitor is consequently isolated. 

The GOGO model is used to generates a TRC on the basis of equation 
Y=(aX+b/+c (P=Y) obtained by adding an offset term c to the GOG model. The 
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GOGO model as proposed in the las. committee draft of IEC61966-3. The GOGO 
model can represents the tone characteristics of the monitor very well when the GOG 
cannot make an appropriate correction (as the black level of the monitor is isolated) 
because of the correcting effect of the offset term of c. 

The TRC model selecting section 7 1 5 selects the simple model when the gain 
coefficient a is equal to 1 and the offset coefficient b is equal to 0. Otherwise, it 
elects the GOGmodel. When the GOGtnodel is selected by the TRCmodel selecting 
section 715, me TRC preparing section 722 uses in Step S45 me data obtained by 
measuring the XYZ3-sthnulus values of the numerical tone of each of the colors of 
RGB to determine the parameters of the GOG model and three TRCs by means of the 
non-linear optimization technique as seen from the flow chart of FIG. 18. Note mat, 
although the flow chart of FIG. 18 shows the operation only for red, it equally applies 
to green and blue. 

Thus, referring to FIG. 18, in the firs, step of Step S71, 3-stimulus values are 
determined for the numerical tone by sampling input digital signal dr and, in Step S72, 
the input signal dr is normalizedby dividing it by 2--1. Then, in Step S73, the output 
value X, of the obtained 3-stimulus values is normalized by dividing it by maximum 
value of X,„ (which is also determined by measurement). 

In Step S74, an operation of non-linear interpolation (non-linear optimization) 
is performed statistically according to the data on the input digital signal dr and the 
output value X, and equation (56) below. Then, in Step S75, the coefficients k,,,,, 
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K offset and Y r in equation (56) will be determined. 
y ( dr V r 

Xr, max V X 1 

-.(56) 

Returning to FIG. 17, when it is determined in Step S44 that the monitor is not 
a CRT, the operation proceeds to Step S49, where the TRC preparing section 722 
generates a total of three one-dimensional look-up tables (LUTs) for each of the 
channels for RGB between the quantities of light (r, g. b) obtained from the data on the 
XYZ3-stimulus values for the numerical tone of each of the colors of RGB and the , 

input digital signals (dr, dg, db). 

After the processing operation of Step S45 or Step S49, the operation proceeds 
to Step S46, where the addition law evaluating section 713 determines if the law of 
addition (for mixing colors) holds true or not. The law of addition is determined to 
hold true when the maximum brightness Y Wmax for white corresponds to a value 
between 95 percent and 105 percent of the sum of the maximum brightness values for 
RGB (Y_ + + Y^- ^ it is determined in Step S46 that the law of addition 
holds true, the operation proceeds to Step S47, where the matrix selecting section 714 
selects the 3 x 3 matrix shown in equation (2) and the matrix preparing section 721 

actually prepares the matrix. 

If it is determined that the law of addition does not hold true in Step S46, the 
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operation proceeds to Step S50, where the user determines to generate either a 3 x N 
matrix or a three-dimensional look-up table. Then, the matrix preparing section 721 
actually prepares a 3 x N matrix or a three-dimensional look up table between the 
quantities of light (r, g, b) for RGB and the XYZ3-stimulus values. 

If, for example, it is determined that a 3 x 8 matrix is to be prepared, a 3 x 8 
matrix for generating (X CRT> Y CRT , Z CRT ) will actually be generated on the basis of (r, 
g, b, 1, rg, gb, br, rgb) as shown in equation (57) below. 



XcRT 
YCRT 
ZcRT 



= A/ 3 * 8 



r 

g 

b 

I 

rg 
gb 
br 
rbg 



...(57) 

Then, if it is determined in Step S43 that a black isolation exists, the operation 
proceeds to Step S51, where the user determines if the black isolation has to be 
corrected or not. If a black isolation exists only slightly and hence is hardly 
observable, it will be determined that the black isolation does not need to be corrected. 
If the black isolation is clearly observable, it will be determined that the black isolation 
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needs to be corrected. Then, the processing operation proceeds to Step S52, where the 
TRC model selecting section 715 determines if the monitor is a CRT or not. If the 
nronitor is a CRT, the operation proceeds to Step S54, where the TRC model selecting 
section 715 selects the GOGO model and the TRC preparing section 722 determines 
the parameters for the GOGO model by means of a non-linear optimization technique, 
usmg the data obtained by subtracting the XYZ3-stimulus values for input digital 
signals of (0, 0, 0) from the XYZ3-stimulus values for the numerical tone of each of 
the three colors of RGB and then also deterrmnes three TRCs as shown in equation 
(47). 

FIG. 19 shows a flow Chart that can be used for the operation of preparing TRCs 
by means of the GOGO model. Since Steps SSI through S85 are basically identical 
with the corresponding steps of FIG. 18, they will not be described in detail here, 
although the flow chart of FIG. 19 differs from that of FIG- 18 in that data are obtained 
by subtracting the XYZ3-stimulus values for input digital signals of (0, 0, 0) from the 
XYZS-stimulus values for the numerical tone of each of the three colors of RGB in 
Step S81 and then used with equation (47) in Steps S83 and S84. Then, with the 
GOGO model, the offset term c' is determined in addition to k'^, k' ofli<1 and y'. 

After the processing operation of Step S54, the operation proceeds to Step S55, 
where the addition law evaluating section 713 determines if the law of addition holds 
true or not and, if the law holds true, the operation moves to Step S56, where the 
matrix selecting section 714 select a 3x4 matrix as expressedby equation of (5 1) above 
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and the matrix preparing section 721 actually prepares the matrix from the four sets 
of data of the 3-stimulus values when the inputs for RGB are maximum and the 
XYZ3-stimulus values when the input digital signals are (0, 0, 0). 

If it is determined by the TRC model selecting section 71 5 that the monitor is 
not a CRT in Step S52, the operation proceeds to Step S53, where the TRC preparing 
section 722 prepares a total of three one-dimensional look-up tables for each of the 
channels for RGB between the quantities of light (r m , g"\ b m ) obtained from the data 
obtained by subtracting the XYZ3-stimulus values for input digital signals of (0, 0, 0) 
from the XYZ3-stimulus values for the numerical tone of each of the three colors of 
RGB and the input digital signals (dr, dg, db). Thereafter, the operation proceeds to 
Step S55 and then to the subsequent steps. 

If, on the other hand, that the law of addition does not hold true in Step S55, the 
operation moves to Step S50, where the matrix preparing section 721 uses the 
3-stimulus values obtained by measuring several displayed colors of the monitor 
recommended by the IEC to generate coefficients for a 3 * N matrix by linear 
recurrence or a three-dimensional look-up table between the quantities of light for 
RGB (r m , g"', b m ) and the XYZ3-stimulus values. 

If it is determined in Step S5 1 that the black isolation does not need correction, 
the operation proceeds to Step S57, where it is determined if the monitor is a CRT or 
not. If it is determined that the monitor is a CRT, the operation moves to Step S58, 
where the user selects either the GOG model or the GOGO model and the TRC 
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preparing section 722 actually generates the selected model. 

«; onthe otherband, itis determined in Step S57 mature monitoris not a CRT, 
the operation moves to Step S 5 9, where the TRC preparing section 722 generates 

one-dimensional look-up tables. 

Aft er d >eprocess i ngo P erationofStepS5 8 orS,e P S59,mStepS60,d 1 eaddition 

law eva lu at m gsection713determmesif t he,a W o f additionho,dsm l eornoand, 1 fthe 

law of addition holds true, the user se.ects either generation of a 3 * 3 matrix or that 
of a 3 * 4 matrix in Step S61 so tha, tire matrix preparing section 721 prepares the 

trr,™ the measured XYZ values for the 32 colors 
requested matrix by linear.recurrence from the measured A 

. , c t «r, cao that the law of addition 

of the EC. If, on the other hand, it is determined m Step S60 that m 

* c+^t, where a 3 * N matrix or a 
does not hold true, the operation moves to Step S50, where 

.hree-dimensional look-up table will be generated. 

tt it is determined in Step S42 that the law of propottion does no, holds true, the 
operation proceeds to Step S62, where the addition law evaluating sect.cn 713 
oetermmesifmelawofadmtionho.dstrneornot.lfhisdetermme.matthelawof 

addi tion does not hold true, me operation proceeds to Step S65, where me TRC 
preparing section 722 prepares a three-dimensional loot-up table between the 
q uantities of Ught for RGB (r, g, b) and me XYZ3-smnu,us va.ues. If, on the other 
hand i, is determined m Step S62 mat me law of addition holds true, the operatmn 
proceeds to Step S63; where the TRC preparing section 722 determines the GOGO 
parameters from me measured XYZJ-stimums values for each oftheRGB by means 
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of the non-linear optimization technique and prepares a total of nine TRCs including 
three TRCs for the three X values obtained by equations (52), three TRCs for the three 
Y values and three TRCs for the three Z values, while the profile preparing section 
723 generates modified equations for XYZ as shown in (55). 

After the processing operations in Steps S47, S50, S56, S61, S64 and S65, in 
Step S48, the profile preparing section 723 processes the XYZ3-stimulus values. 

Thus, if the black level of the monitor is isolated as a result of that the user 
arbitrarily modifies the contrast and the brightness of the monitor, the colors of the 
monitor can be calibrated accurately without increasing the number of measurements 
for evaluating the color reproduction characteristics of the monitor. 

Note that the operation of generating a 3 * 4 matrix using the equation of (5 1) 
may be replaced by an operation of generating a 3 x 3 matrix using the equation of 
(58) as shown below, converting the values of (r m , g m , b'") representing the quantities 
of light that are non-linearly corrected by the TRCs by means of the 3 * 3 matrix and 
then adding the XYZ3-stimulus values for the digital signals of (0, 0, 0). 
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...(58) 

Note that the media that can be used to transmit the computer program for the 
above processing operation include recording media such as magnetic discs, 
CD-ROMs and solid , memories as well as communication media such as 
communication networks and satellites. 

The present invention can provide an apparatus and a method for processing 
images as well as a providing medium that are adapted to properly correct the colors 
of images. 

Additionally, the present invention can provide an apparatus and a method for 
processing images as well as a providing medium that are adapted to automatically 
update the chromatic profile of a monitor for color matching. 

Still additionally, the present invention can provide a system and a method for 
transmitting/receiving images as well as a providing medium that are adapted to make 
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the appearance of the image at the transmitter agree with that of the image at the 
receiver in terms of colors. 

Still additionally, the present invention can also provide an apparatus and a 
method for processing images as well as a providing medium that are adapted to 
accurately calibrate the chromatic profile of a monitor with a minimal amount of data 
obtained by measurement if the black level is isolated. 

Furthermore, the present invention can provide an apparatus and a method for 
processing images as well as a providing medium that are adapted to accurately carry 
out an operation of chromatic calibration with a minimal amount of data obtained by 
measurement 
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CLAIMS 

1. An image processing apparatus for causing a display section to 
provide a display corresponding to image data, the apparatus comprising: 
detection means for detecting if a law of proportion holds true or 

5 not; 

first generation means for generating nine tone reproduction curves 
in response to the outcome of detection of said detection means; and 

second generation means for generating formulae for obtaining 
device-independent color signals from said nine tone reproduction curves 
10 generated by said generation means and 3-stimulus values for black level. 
2. An image processing method to be used for an image processing 
apparatus operative to cause a display section to provide a display 
corresponding to image data, the method comprising: 

a detection step of detecting if a law of proportion holds true or not; 
15 a first generation step of generating nine tone reproduction curves 

in response to the outcome of detection of said detection step; and 

a second generation step of generating formulae for obtaining 
device-independent color signals from said nine tone reproduction curves 
generated in said first generation step and 3-stimulus values for black 
20 level. 
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3. A providing medium for providing an image processing apparatus 
operative to cause a display section to provide a display corresponding to 
image data with a computer-readable program for causing said apparatus 
to perform a processing method according to claim 2. 
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